standard machine
NCDL: A Framework for Deep Learning on non-Cartesian Lattices
The use of non-Cartesian grids is a niche but important topic in sub-fields of the numerical sciences such as simulation and scientific visualization. However, non-Cartesian approaches are virtually unexplored in machine learning. This is likely due to the difficulties in the representation of data on non-Cartesian domains and the lack of support for standard machine learning operations on non-Cartesian data. This paper proposes a new data structure called the lattice tensor which generalizes traditional tensor spatio-temporal operations to lattice tensors, enabling the use of standard machine learning algorithms on non-Cartesian data. However, data need not reside on a non-Cartesian structure, we use non-Dyadic downsampling schemes to bring Cartesian data into a non-Cartesian space for further processing. We introduce a software library that implements the lattice tensor container (with some common machine learning operations), and demonstrate its effectiveness. Our method provides a general framework for machine learning on non-Cartesian domains, addressing the challenges mentioned above and filling a gap in the current literature.
NCDL: A Framework for Deep Learning on non-Cartesian Lattices
The use of non-Cartesian grids is a niche but important topic in sub-fields of the numerical sciences such as simulation and scientific visualization. However, non-Cartesian approaches are virtually unexplored in machine learning. This is likely due to the difficulties in the representation of data on non-Cartesian domains and the lack of support for standard machine learning operations on non-Cartesian data. This paper proposes a new data structure called the lattice tensor which generalizes traditional tensor spatio-temporal operations to lattice tensors, enabling the use of standard machine learning algorithms on non-Cartesian data. However, data need not reside on a non-Cartesian structure, we use non-Dyadic downsampling schemes to bring Cartesian data into a non-Cartesian space for further processing.
Training a multilayer dynamical spintronic network with standard machine learning tools to perform time series classification
Plouet, Erwan, Sanz-Hernández, Dédalo, Vecchiola, Aymeric, Grollier, Julie, Mizrahi, Frank
Ross et al. have experimentally demonstrated a multilayer network of spintronic oscillators, but with a feedforward architecture dedicated to static tasks [24]. The ability to process time-series (classification, prediction, Rodrigues et al. have shown by numerical simulations generation etc.) is important for many applications how to train the transient dynamics of a single layer network from smart sensors in industrial maintenance to of oscillators with optimal control theory, on a static personal assistants and medical devices. Using the dynamics task [25]. of a physical system, leveraging its non-linearity and memory for such processing has been widely explored Here we simulate and train a multi-layer network of with the development of recurrent neural networks, both spintronic oscillators as neurons, using standard machine from a purely mathematical perspective [1-4] as well as learning tools. We leverage the transient dynamics of the from a brain-inspired perspective with spiking recurrent oscillators to perform time-series classification of the sequential neural networks [5-8]. Chen et al. have shown that
Machine Learning with Requirements: a Manifesto
Giunchiglia, Eleonora, Imrie, Fergus, van der Schaar, Mihaela, Lukasiewicz, Thomas
In the recent years, machine learning has made great advancements that have been at the root of many breakthroughs in different application domains. However, it is still an open issue how make them applicable to high-stakes or safety-critical application domains, as they can often be brittle and unreliable. In this paper, we argue that requirements definition and satisfaction can go a long way to make machine learning models even more fitting to the real world, especially in critical domains. To this end, we present two problems in which (i) requirements arise naturally, (ii) machine learning models are or can be fruitfully deployed, and (iii) neglecting the requirements can have dramatic consequences. We show how the requirements specification can be fruitfully integrated into the standard machine learning development pipeline, proposing a novel pyramid development process in which requirements definition may impact all the subsequent phases in the pipeline, and viceversa.
Interactive Machine Learning: A State of the Art Review
Wondimu, Natnael A., Buche, Cédric, Visser, Ubbo
Machine learning has proved useful in many software disciplines, including computer vision, speech and audio processing, natural language processing, robotics and some other fields. However, its applicability has been significantly hampered due its black-box nature and significant resource consumption. Performance is achieved at the expense of enormous computational resource and usually compromising the robustness and trustworthiness of the model. Recent researches have been identifying a lack of interactivity as the prime source of these machine learning problems. Consequently, interactive machine learning (iML) has acquired increased attention of researchers on account of its human-in-the-loop modality and relatively efficient resource utilization. Thereby, a state-of-the-art review of interactive machine learning plays a vital role in easing the effort toward building human-centred models. In this paper, we provide a comprehensive analysis of the state-of-the-art of iML. We analyze salient research works using merit-oriented and application/task oriented mixed taxonomy. We use a bottom-up clustering approach to generate a taxonomy of iML research works. Research works on adversarial black-box attacks and corresponding iML based defense system, exploratory machine learning, resource constrained learning, and iML performance evaluation are analyzed under their corresponding theme in our merit-oriented taxonomy. We have further classified these research works into technical and sectoral categories. Finally, research opportunities that we believe are inspiring for future work in iML are discussed thoroughly.
AI Study Shows Why Deep Learning Is Suited for Neuroscience
In the realm of artificial intelligence (AI), not all machine learning approaches are considered equal. This is an important consideration in fields such as neuroscience, medicine, biotechnology, life sciences, health care, genomics, pharmaceuticals, and other industries where accuracy may directly impact human health and safety. In a new study published earlier this month in Nature Communications, researchers at Georgia State University show the advantages of deep learning (DL) over standard machine learning (SML) in brain research. "Our findings highlight the presence of nonlinearities in neuroimaging data that DL can exploit to generate superior task-discriminative representations for characterizing the human brain," wrote the paper's lead author Anees Abrol along with Sergey Plis, Vince Calhoun, Yuhui Du, Rogers Silva, Mustafa Salman, and Zening Fu. In standard machine learning, predictions are a result of processing prediction functions via inference rules, and the decision boundaries are determined in the "native, kernel-transformed, or feature-engineered input spaces."
Python Machine Learning Mini-Course
Python is one of the fastest-growing platforms for applied machine learning. In this mini-course, you will discover how you can get started, build accurate models and confidently complete predictive modeling machine learning projects using Python in 14 days. This is a big and important post. You might want to bookmark it. Python Machine Learning Mini-Course Photo by Dave Young, some rights reserved.
A Gentle Introduction to PyCaret for Machine Learning
PyCaret is a Python open source machine learning library designed to make performing standard tasks in a machine learning project easy. It is a Python version of the Caret machine learning package in R, popular because it allows models to be evaluated, compared, and tuned on a given dataset with just a few lines of code. The PyCaret library provides these features, allowing the machine learning practitioner in Python to spot check a suite of standard machine learning algorithms on a classification or regression dataset with a single function call. In this tutorial, you will discover the PyCaret Python open source library for machine learning. A Gentle Introduction to PyCaret for Machine Learning Photo by Thomas, some rights reserved.
Step-By-Step Framework for Imbalanced Classification Projects
Classification predictive modeling problems involve predicting a class label for a given set of inputs. It is a challenging problem in general, especially if little is known about the dataset, as there are tens, if not hundreds, of machine learning algorithms to choose from. The problem is made significantly more difficult if the distribution of examples across the classes is imbalanced. This requires the use of specialized methods to either change the dataset or change the learning algorithm to handle the skewed class distribution. A common way to deal with the overwhelm on a new classification project is to use a favorite machine learning algorithm like Random Forest or SMOTE. Another common approach is to scour the research literature for descriptions of vaguely similar problems and attempt to re-implement the algorithms and configurations that are described. These approaches can be effective, although they are hit-or-miss and time-consuming respectively.
Task-Based Learning via Task-Oriented Prediction Network
Chen, Di, Zhu, Yada, Cui, Xiaodong, Gomes, Carla P.
Real-world applications often involve domain-specific and task-based performance objectives that are not captured by the standard machine learning metrics, such as mean squared error, mean absolute error, and cross-entropy loss, but are critical for decision making. A key challenge for direct integration of more meaningful domain and task-based evaluation criteria into an end-to-end gradient-based training process is the fact that often such performance objectives are not necessarily differentiable and may even require additional decision-making optimization processing. We propose Task-Oriented Prediction Network (TOPNet), an end-to-end learning scheme that automatically integrates task-based evaluation criteria into the learning process via a task-oriented estimator and directly learns a model with respect to the task-based goal. A major benefit of the proposed TOPNet learning scheme lies in its capability of automatically integrating non-differentiable evaluation criteria. This makes it particularly suitable for diversified and customized task-based evaluation criteria in real-world prediction tasks. We validate the performance of TOPNet on two real-world financial prediction tasks, revenue surprise forecasting and credit risk modeling. The experimental results on multiple real-world data sets demonstrate that TOPNet significantly outperforms both traditional modeling with standard losses and modeling with differentiable (relaxed) surrogate losses.